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Abstract 
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■  Systems  Engineering  for  large,  high-technology,  aerospace  programs  is 
historically  complex  and  broad  in  scope. 


■  We  present  a  logical  and  practical  path  toward  leaner  and  more  agile 
systems  engineering  beginning  with  a  high-level  overview  of  typical 
systems  engineering  processes.  Emphasis  is  on  activities  and  processes 
amenable  to  improvement  by  adapting  Agile  practices. 


■  This  presentation  is  limited  to  a  small  subset  of  early  SE  activities 


■  This  presentation  shows  example  candidate  areas  that  can  benefit  from 
the  application  of  Agile  practices,  and  identifies  efforts  currently 
underway  to  apply  these  practices  to  new  and  ongoing  development. 


“Agility  is  the  ability  to  both  create  and  respond  to  change  in  order  to 
profit  in  a  turbulent  business  environment.” -  Jim  Highsmith 
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First,  a  Primer:  Key  Focus  of  Systems 
Engineering 
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Drivers  for  Agile  Systems  Engineering 

Leverage  "I ighter  weight "  tailored  Svste m s 
Engineering  process  for  urgent  needs,  rapid 
fielding  and  technology  insertion... .accelerate 
delivery  of  technical  capabilities  to  win  the  current 
fight  bv  using  agile  SE  to  incrementally  /  quickly 

evaluate  changing  requirements 

Copyright  ©2010  Boeing.  All  rights  reserved. 
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The  SE  ‘Engine’  from  an  Ops  Analysis  Perspective 
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SE  is  process-based  and  often  influenced 


Process  Input 

-  Cus:omer  Need^Osjectivesi' 
Requirements 

-  Missions 

-  Measures  of  Effectiveness 

-  Environments 

-  Constraints 

-  Technology  Ease 

■  Output  Requirements  from  Prior 
Development  Effcr 

■  Program  Dedsian  Requ  remems 

-  Requ  remenis  Applied  Through 
Bpedfications  and  Standards 


Stated  Terms: 

Customer  =  Organizations  responsible  far  Primary  Functions 
Primary  Functions  =  Development.  Product'an-Construction.  Verification, 
Deployment.  Operations,  Support,  Training,  Disposal 
Sys:ems  Elements  =  Hardware,  Software.  Personnel.  Facilities,  Data,  Material, 
Services,  Techniques 


Process  Output 

■  Development  Level  Dependent 
-Decision  Database 

-  System, 'Configuration  Item 
Anchitec'ure 

-  Specifications  and  Baselines 
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Where  to  Start?  An  Aerospace  Bjg  Picture  View 

Systems  Engineering  views  SE  involvement  across  a  product  life  eye 

Boeing  Defense,  Space  &  Securityl  Lean-Agile  Software 


Verifl(0lgii  ami 

Validation 


Operations 

and 

Maintenance 


Concept  ol 

Operations 


System 
Verification 
and  Validation 


Requirements 

and 

Architecture 


Integration, 
Test,  and 

Verification 


Detailed 

Design 


Operations/ 
Systems  Analysis 


Project 

Definition 


Systems  Architect 
and  Definition 


Systems  Engineering  Management 
across  Life  Cycle 


Key 

Enablers 


Project 

Test  grid 
Integration 


Customer 

Engineering 

Affordability 

Modeling  and 
Simulation 


Time 


Integration,  Verification  &  Validation 


integr 

"Systems!!: 


ngineering  Measurement  &  Control" 


Communications  &  Network  SE 
Reliability,  Maintainability  &  Systems  Health 
Survivability,  Vulnerability  &  Susceptibility 
Human  Factors  &  Ergonomics 
Flight  Crew  Operations  Integration 


Flight  Deck/Runway 
Design 

Certification/Qualification 
Regulatory  Development 
Systems  Security  &  Safety 
Operations 


Copyright  ©2010  Boeing.  All  rights  reserved. 


Source:  http://www.  thefullwiki.  org/V-Model 


Analysis/MS&A  Author,  4/25/2011,  FilenarSlj^  5 


Look  to  Early  Product  Life  Cycle  Activities 
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■  If  you  accept  that: 

■  Agile  has  been  successful  with  software  because  it  is  ‘soft’*  and  lends  itself  to 
the  qualities  of  Agile  and  Scrum 


■  Then  you  could  accept  that: 

■  Some  Systems  Engineering  activities  produce  ‘soft’  artifacts  that  support  HW 
activities  (where  Agile  is  more  difficult  to  instantiate)  and  could  be  candidates 
for  ‘agilizing’ 


■  Where  can  you  find  many  examples  of  'soft’  Systems  Engineering 
activities? 

■  In  the  early  ‘Front  End’  Conceptual  Phase 


*'Generally  describes  elements  and  activities  that  produce  artifacts  with  a  high  degree  of  flexibility  and  latitude  in  its  definition, 
execution,  and  outputs,  such  as  studies  and  analyses. 
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Cumulative  Percentage  Life  Cycle  Cost  against  Time 


The  Importance  of  SE  at  the  Front  End  of 
Programs 
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The  percentages  along  the  time 
line  represent  the  actual  life-cycle 
cost  (LCC)  accrued  over  time 
based  on  a  statistical  analysis 
performed  on  projects  in  the  U.S. 
Department  of  Defense  (DOD)  as 
reported  by  the  Defense 
Acquisition  University 

As  shown,  the  Concept  Stage  of  a 
new  system  averages  8%  of  the 
total  LCC. 

The  curve  for  committed  costs 
represents  the  amount  of  LCC 
committed  by  project  decisions. 


Committed  Life-Cvcle  Cost  vs.  Time 


INCOSE  SE  Handbook,  pg.  15:  “[This}  figure  also  demonstrates  the  consequences  ofmakincL  early  decisions  without  the  benefit  of_good 
information  and  analysis.  SE  extends  the  effort  performed  in  concept  exploration  and  design  to  exceed  the  percentages  shown  in  the 
cumulative  committed  cost  curve  and  reduce  the  risk  of  hasty  commitments...” 

Source:  INCOSE  Systems  Engineering  Handbook  v.  3.2,  January  2010;  INCOSE;  Defense  Acquisition  University,  1993 
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What  does  SE  do  in  the  Front  End? 
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Conceptual  System  Design  Phase  Activity 
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Examples: 

■  Early  Problem  Definition  &  Need  Identification 

■  Advanced  System  Planning 

■  Evaluation  &  Trade  Studies 

■  System  Feasibility  &  Requirements  Analysis 

■  Measures  of  Effectiveness/Technical  Performance  Measures 

(MOE  /  TPM)  Investigation 

■  Output  Supports  Modeling  and  Simulation  activities 

■  Culminates  in  a  Conceptual  Design  Review 


Copyright  ©2010  Boeing.  All  rights  reserved. 
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An  Agile  SE  Example:  Trade  Studies 
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■Trade  Studies  at  early  program  stages  are  often  oriented 
towards  determining  technical  feasibility  and  focusing  on 
reducing  the  solution  space 


■Activities  include  articulating  the  purpose,  identifying  scope 
and  constraints,  etc. 


■Trade  Studies  are  applicable  to  each  level  of  the  system 
architecture 


■Application  examples  include  technologies,  suppliers, 
‘boxes’,  etc. 
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Applying  Agile  to  the  Trade  Study  Downselect 
Alternatives  Process 
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■  Identify  evaluation  criteria  &  weighting  factors  iteratively 

■  Define  purpose,  scope,  constraints,  assumptions 

■  Identify  initial  list  of  alternatives 

■  Apply  evaluation  method  for  analyzing  initial  list  of  alternatives 

■  Downselect  alternatives  iteratively 

■  Apply  evaluation  method  for  analyzing  initial  list  of  alternatives 

■  Perform  detailed  analysis  iteratively 

■  Apply  evaluation  method  for  analyzing  initial  list  of  alternatives 

■  Identify  recommended  alternatives 
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Agile  Systems  Engineering  Trade  Study 
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General  Steps  of  a  Trade  Study: 

Define  the  purpose  of  the  trade  study 

Plan  the  trade  study 

Describe  the  assumptions  for  the 
trade  study 

Define  the  evaluation  criteria  and 
assign  weighting  factors 

Identify  and  develop  alternatives 

Evaluate  alternatives  against  the 
evaluation  criteria 

Recommend  a  decision  based  on  the 
evaluation  of  the  alternatives 

Document  recommendations  and 
rationale  in  a  report 

Review  and  accept/reiect  the  trades 
study  recommendations  and  report 

Source:  INCOSE  Systems  Engineering  Handbook  v.  3.2,  January  2010; 
INCOSE;  Defense  Acquisition  University,  1993 

Copyright  ©2010  Boeing.  All  rights  reserved. 


Suggested  AgileSE  Trade  Study 

Implements  most  of  the  Agile 
practices  and  principles 

Applies  the  Scrum  framework  where 
roles,  activities,  and  artifacts  are 
essentially  the  same 

At  the  end  of  each  iteration,  the 
product  backlog  “baseline”  has 
evolved  into  a  clearer  and  more 
complete  set  of  requirements 

Acceptance  tests  are  written  for  each 
backlog  item  (dependent  upon  the 
type  of  TS) 

Attributes,  constraints,  and 
dependencies  are  identified 

All  data  is  managed  and  controlled 
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Agile  Systems  Engineering  will  Challenge  the 
Paradigm 
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Recommendations: 

■  Find  a  Champion 

■  Look  for  SE  opportunity  areas  early  in  the  Lifecycle 

■  Look  for  discrete  job  chunks  that  can  be  easily  defined  &  are  amenable  to 
implementing  Scrum  practices 

■  Consider  selecting  a  bounded  pilot  project  executing  a  specific  activity 
(such  as  a  TS) 

■  Suggest  developing  Agile  Checklists  that  reflects  your  AgileSE  concerns: 

■  Level  of  Uncertainty  &  Agility  Needed 

■  Cost,  Risk  (Assessment  of  Risk  is  key) 

■  Metrics  to  gauge  progress,  improvement,  and  satisfaction 

■  Recognize  that  you  will  want  to  deliver  the  product  neec/ec/  at  the  end  and  not  necessarily 
what  was  requested  at  the  beginning 


Copyright  ©2010  Boeing.  All  rights  reserved. 
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Challenges  Going  Forward 
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■  Cultural  acceptance  of  Agile  within  Systems  Engineering 


■  Acceptance  of  AgileSE  from  Acquisition  &  Contractual 
organizations 

■  Oversight,  Documentation,  Detailed  Planning  issues 


■  Expanding  Agile  to  successfully  address  mid-late  product  life 
cycle  issues 

■  Applicability  of  Agile  methods  and  practices  to  Prototyping, 
Manufacturing,  Production,  etc. 


■  Educating  SE  Leadership  and  Teams  on  implementing, 
practicing,  and  sharing  successful  AgileSE  implementations 


Copyright  ©2010  Boeing.  All  rights  reserved. 
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Software  Architecture  in  Agile 
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Experience  in  2007-2009:  Agile  Software  Requireme 
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■  System  development  that  required  modifying  a  large 
enterprise  COTS  application  across  several  engineering 
domains 


■  A  more  efficient  approach  was  needed 


■  A  release  plan  was  established  aligned  to  the  scheduled 
mandate 


■  The  Agile  Scrum  approach  was  selected  to  manage  the 
project 


■  Teams  were  staffed  with  system  engineers  to  develop 
software  requirements  through  a  series  of  4-week  iterations 
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Process  Development  in  201 
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The  model  below  illustrates  a  much  tighter  collaboration  between  Agile  system 
engineering  teams  and  Agile  software  teams 


Copyright  ©  2010  Boeing. 


Author,  4/25/2011,  Filename. ppt  |  1  7 


Process  and  Direction  Going  Forward 
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■  The  direction  now  is  to  define  specific  Agile  practices  that  can  be  used  to 
enable  more  efficient  activities  for  the  larger  system  engineering  effort 


■  Develop  several  Agile  templates  of  typical  SE  artifacts 

■  SEMP 

■  Trade  Study 

■  IV&V 

■  Etc. 


■  Organize  and  prioritize  SE  activities  and  develop  SE  artifacts  by 
implementing  Agile  practices: 

■  Active  customer  participation 

■  Short  daily  stand-up  meetings 

■  Planning  and  estimating 

■  Frequent  deliveries 

■  Short  iterations 

■  Prioritized  requirements 

■  Artifact  reviews 

■  Self-organized  teams 

■  Frequent  delivery 

■  Simplicity 

■  Sustainable  pace 
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Backup 
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Agile  Principles  and  Practices 
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■  Agile  is  a  philosophy  defined  by  principles  and  practices  that  drive  quick  delivery 
of  quality  software  and  encourage  user  feedback 


Principles: 


Customer  Satisfaction 
Frequent  Delivery/Deployment 
Motivated  Team 
Working  Software 
Technical  Excellence 
Emergent  Design 


Embrace  Change 
Collaboration 
High  Bandwidth 
Sustainable  Pace 
Simplicity 

Continuous  Improvement 


Practices: 


Close  customer  collaboration 
Daily  stand-up  meetings 
Continuous  integration 
Automated  testing 
Planning  and  estimating 


Short  iterations 
Test-driven  development 
Prioritized  requirements 
Product  demonstrations 
Self-organized  teams 
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Agile  Practices  Often  Used 
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Continuous  planning 
Short  iterations  (2  to  4  weeks) 
On-site  customer  or  proxy 
Self-organized  teams 


Daily  stand-ups 
Feature-based  planning 
Information  radiators 
Inspections 
Monitor  and  adjust 


Pair  programming 


Small  releases 


Prioritized  requirements 
Automated  testing 
Refactoring 

Continuous  integration  and  CM 


Test  first 


Retrospectives 
Risk  management 
Unit  testing 
User  stories 
Empowered  team 
Bottleneck  management 
Demonstration 


Simple,  robust  design  Source:  Agile  Alliance  (www.agilealliance.org) 
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Some  Lessons  Learned 
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■  Focused,  face-to-face  iteration  sessions  improve  team  synergy 

■  Appoint  someone  to  maintain  specified  time  boxed  activities 

■  First  estimating  round  should  focus  on  perceived  size,  complexity,  or  difficulty  (in 
nebulous  units) 

■  Scrum  Master  should  work  with  management  to  resolve  unplanned  organizational 
impediments  that  affect  work  tasks 

■  Avoid  side  discussions  that  disrupt  team  momentum 

■  Attend  all  daily  stand-ups  (best  way  to  know  health  and  progress  of  team) 

■  Working  as  a  team  helps  everyone  understand  tasks  and  how  to  formulate  stories 

■  Team  consultations  with  domain  SMEs  help  clarify  misunderstandings 

■  Ensure  requisite  architecture,  infrastructures,  technologies,  and  tools  are  in  place 
before  starting  team  activities 

^  I  OQ 
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Common  Agile  Terms 
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-  Agile 

■  Burndown  Chart 

■  Daily  Scrum 

■  Iteration  or  Sprint  Backlog 

■  Iteration  Planning 

■  Product  Backlog 

■  Product  Owner 

■  Scrum 

■  ScrumMaster 

■  Story 

■  Sprint 

■  Task  Board 

■  Team 
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